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FIRST-ORDER LIMITS, AN ANALYTICAL PERSPECTIVE 


JAROSLAV NESETRIL AND PATRICE OSSONA DE MENDEZ 


Abstract. In this paper we present a novel approach to graph (and struc¬ 
tural) limits based on model theory and analysis. The role of Stone and 
Gelfand dualities is displayed prominently and leads to a general theory, which 
we believe is naturally emerging. This approach covers all the particular ex¬ 
amples of structural convergence and it put the whole in new context. As an 
application, it leads to new intermediate examples of structural convergence 
and to a “grand conjecture” dealing with sparse graphs. We survey the recent 
developments. 


1. Introduction 

Let G\, G 2 , ■ ■ ■, G n be a sequence of graphs with increasing orders. The theory 
of graph limits allows us to capture some common features of such a sequence 
by a single structure, the limit object. Such features include property testing and 
subgraph frequencies. Positive instances of this procedure are related to both dense 
and sparse graphs. This recently very active area of combinatorics is discussed for 
instance is [23] - 

Can one demand that the limit object satisfies some further properties such as 
degree distribution, or bounded diameter, or non-existence of certain subgraphs? 

This we approach by the notion of first-order limits of structures, which was 
introduced in [30]S2 ■ 

This approach is based on the combination of model theory and functional anal¬ 
ysis, and proved to be useful in dealing with “intermediate” classes, such as the 
class of trees and forests [32J. It also generalizes (and as well puts in a new context) 
several notions of graph convergence studied earlier 0 casual. 

In Sections [3] [6] we review here some of these results. However we also provide 
a new setting which generalizes and complements the earlier work of the authors 
[30] . We now view our approach as a natural approach, which lies midway between 
functional analysis approach to quantum theory and limits of graphs. This, perhaps 
even closer to functional analysis, we tried to explain in Section [2j 
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Here is an outline of what we do: We generalize aspects of the theory of graph 
limits, moving from a study a homomorphism and subgraph profiles to consider¬ 
ing full statistics of first-order formula satisfaction. In our setting the underlying 
notion of convergence is, in essence, model theoretic, a relies on the the following 
notion [30l : 

For a cr-structure A and a first-order formula <fi (in the language of cr, with free 
variables X\,... , x p ), we denote by </>(A) the satisfying set of 4> in A: 

<K A ) = {(^ 1 , • • •, v p ) G A p : A\= <t>{y i,..., u p )}, 


and we define the Stone pairing of <f> and A as the probability 


( 1 ) 


<^,A) 


MA)| 

\M P 


that A satisfies <f> for a (uniform independent) random interpretation of the random 
variables. 

A sequence (A„) rag r{ of finite cr-structures is FO-convergent if the sequence 
((0- A n)) converges for every first-order formula cf >. It is important that one 
can derive a weakened notion of X-convergence (for a fragment X of first-order 
logic) by restricting the range of the test formulas cf> to X. 

We shall see that this abstract generalization of left convergence and local con¬ 
vergence can be seen as a particular (commutative) case of a general framework, 
which occurs naturally in functional analysis (in its description of quantum physics). 
This connection not only legitimates some of the constructions introduced to study 
first-order limits of structures, but it also put the whole framework in perspective, 
for a possible extension to the non-commutative setting of quantum logic. This 
connection will be discussed in Section [2] which may be seen as generalization and 
more uniform treatment of [33] . 

Encouraged by this general analytic setting, we show that first-order limits 
(shortly FO-limits) and, more generally, X-limits can be uniquely represented by a 
probability measure p on the Stone space S dual to the Lindenbaum-Tarski algebra 
of the formulas. In this setting, there is a one-to-one map A ha /i A from the class 
of finite cr-structures to the space of probability measures on S , with 


(2) / l<f,(T)dp A (T) = (<f>,A), 

Js 

where 1^ is the indicator function of the clopen subset of S dual to the formula <f> 
in Stone duality. In this setting, a sequence (A„) ng pj of finite cr-structures is first- 
order convergent if and only if the measures pA n converge weakly to some measure 
/i. In such a case, the probability measure p represents the limit of the sequence 
(A n ) ng N and, for every first-order formula <t> it holds 


(3) [ l^,(T)dp(T) = lim f 1^(T) dp An (T) = lim (0, A„). 

JS n—>oo J g n—too 

This answers in a very general form the problem (originally posed by J. Chayes, 
see [23) Introduction]) whether convergence leads to a limit distribution. 

The particular definition |l]) of the Stone pairing of a first-order formula and 
a finite structure can be extended, under certain conditions, to infinite structures. 
An obvious necessary condition for such an extension is that the domain of the 
considered infinite structure should be a measurable space, with the property that 
every first-order definable set is measurable. Note that the difficulty here stands 
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in the fact that the class of definable sets is closed by projections, what is not 
the case of measurable sets. Consequently, we introduce in Section [5] the following 
notions: a Relational Sample Space (RSS) is a relational structure, whose domain 
is a standard Borel space, with the property that every first-order definable subset 
of a power of the domain is measurable (with respect to Borel product measure). 
A modeling M [33] is an RSS equipped with a probability measure denoted pm- 
In this setting, we can extend the definition of Stone pairing to modelings: for a 
modeling M and a first-order formula <f> with free variables x±,... ,x p we define 


(4) 


(0,M) =/"./l,( M )(,l,...„ p )d, M M 


where 1 ^(m) is the indicator function of the set 


(5) = {(v 1 ,...,v p ) & M p : M\= (j>{v!,...,Vp)}. 


This definition naturally leads to the two following representation problems, 
which can be seen as analogs of celebrated Aldous-Lyons problem on graphings. 


Problem 1. Characterize those probability measures p on X for which there ex¬ 
ists a sequence (A fl ) ne N of finite structures such that for every first-order formula 
<j)(x i,..., x p ) it holds 

(6) [ l^,(T)d/r(T) = lim (<j), A n ). 

Jg n->oo 

Problem 2. Characterize those first-order convergent sequences of finite structures 
(A„)„ e N for which there exists a modeling M such that for every first-order formula 
(f> it holds 

(7) {(/>, M) = lim (<f), A n ). 

n—>oo 

As we shall see, such modeling limits do not exist in general (but sometimes they 
do) and thus we shall be interested in the following problem. 

Problem 3. Characterize classes with modeling limits, that is classes C of finite 
structures, such that for every first-order convergent sequence (A„ ) nS N of structures 
in C there is a modeling M such that (4>, M) = lim n _ >00 (</), A„) for every first-order 
formula <f>. 


It appears that this last problem is, perhaps surprisingly, related to the sparse- 
dense dichotomy. The authors introduced in ES HZ] a dichotomy of classes of 
graphs, between (sparse) nowhere dense classes and (dense) somewhere dense classes. 
This dichotomy, which can be expressed in numerous (and non trivially equiva¬ 
lent) ways, appears to be deeply related to first-order related properties of these 
classes. Based on a characterization of nowhere dense classes by means of Vapnik- 
Cliervonenkis dimension of model-theoretic interpretations [Tj and a characteri¬ 
zation of random free hereditary classes of graphs [25J, we proved in [233 that a 
monotone class of graphs with modeling limits is necessarily nowhere dense. We 
believe that nowhere dense-somewhere dense dichotomy actually gives the answer 
to Problem [21 

Conjecture 1 ([35)). Every monotone nowhere dense class of graphs has modeling 
limits. 
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By a combination of model theory and functional analysis methods, we have been 
able to prove some particular cases: classes of graphs with bounded degree, classes of 
structures with bounded tree-depth [S3], as well as the class of all forests £32] admit 
modeling limits. In this paper, we sketch a generalization to any class of graphs 
where the maximum degree is bounded by a function of the girth (or unbounded 
if the graph is acyclic). But before, in the next section, we outline an even more 
general approach (pointing to a possible non-commutative version). 

2. Abstract Analytic Framework 

We introduced in 1301 the notion of first-order limits of structures as a generaliza¬ 
tion and unified treatment of various notions of limits. This notions also provided 
limit objects for new “intermediate classes”. However first-order limits are inter¬ 
esting on their own. Particularly, as we show here, they display a rich spectrum 
of interconnection to the functional analysis approach to quantum theory [12] . For 
instance, the connection to (7*-algebras makes more natural the introduction of 
several spaces and constructions, whose appearance in our framework may have 
earlier seem a little mysterious. 

The formalism we adopt here is indeed close to the one of quantum theory, spe¬ 
cially when considering significant objects and spaces. This aspect will be developed 
in this section, where we consider our approach to structure limits under the lights 
of statistical and quantum physics, as formalized by functional analysis. 

Let us recall some basics: The set of all possible states of a physical system is the 
phase space of the system. In statistical physics, a statistical ensemble is the phase 
space of a physical system together with a method of averaging physical quantities, 
called observables , related to this system. In a classical system with phase space 
Cl, the observable quantities are real functions defined on Cl, and they are averaged 
by integration with respect to a certain probability measure /ion Cl. In a quantum 
system described by vectors in a Hilbert space T~L, the observable quantities are 
defined by self-adjoint operators acting on %, and are averaged using a certain 
positive, normalized functional p, defined on the algebra 21 (TL) of operators on H 
(such functionals on H are called states) [26]. 

2.1. C*-algebras. A new unifying view consists in considering as a primary object 
the C*-algebra 21 of observables. Recall that a C”*-algebra 21 is a Banach algebra 
with an involution x H>■ x*, such that the relation ||x*a;|| = ||cc|| 2 holds for any 
element x £ 21. The two standard examples of C*-algebras are the following (see 
m for the standard text): 

First example is the space Cq(X) of all continuous complex-valued functions 
which vanish at infinity on a locally compact Hausdorff space X , equipped with 
the uniform norm ||/|| = sup^g^- |/(a;)|, and involution defined as the complex- 
conjugate: f*(x) = f{x). Gelfand’s representation theorem states that every com¬ 
mutative C*-algebra 21 is isometrically ^-isomorphic to the algebra C'q(^qc), where 
$21 is the topological space of all the characters of 21 (that is: of the non-zero 
homomorphisms / : 21 -A C) equipped with the relative weak-* topology. Given 
a € 21, one defines the Gelfand transform a of a, that is the function a : $o[ —» C 
by a(f) = f{a). Then the map a ha a defines a norm-decreasing, unit-preserving 
algebra homomorphism from 21 to C'o($ 2 t); which is the Gelfand representation of 
21 . 



FIRST-ORDER LIMITS, AN ANALYTICAL PERSPECTIVE 


5 


The second standard example is the algebra *8 (H) of all bounded linear operators 
on a Hilbert space "H, where involution is defined as the adjoint operator, and norm 
is defined as the operator norm. Gelfand-Naimark theorem states that any C*- 
algebra is isometrically and symmetrically isomorphic to a C*-subalgebra of some 
C*-algebra of the form fB('H) . 

In our (discrete) setting, we shall be interested in the specific case where the alge¬ 
bra 21 of observables is approximately finite [7], that is in the case where there exists 
an increasing sequence 2ti C 2G C • • • C 21 of finite-dimensional sub-C*-algebras of 
21 such that the union |J. 21is norm-dense in 21. Approximately finite C*-algebras 
(or AF C*-algebras) have been fully classified by Elliott |TT] using AT-theory for 
C*-algebras. In particular, a C*-algebra 21 is commutative and approximately fi¬ 
nite if and only if it is the algebra of continuous functions on the Stone space of 
a Boolean algebra (follows from [HJ Proposition 3.1] and Stone duality). This very 
particular case corresponds to the framework we used to study structural limits. 
Fig- ED describes the different mathematical objects entering this grand picture. 


positive linear functionals with norm 1 Gelfand representation 



Figure 1. The different spaces in the standard case 

In this context, let us recall that to each Boolean algebra B is associated a 
topological space, denoted S(B), called the Stone space of B , which is a totally 
disconnected compact Hausdorff space. The points in S(B) are the ultrafilters on 
B, or equivalently the homomorphisms from B to the two-element Boolean algebra. 
The mapping K : B -A 2 S ^ B ' > defined by 

K{<j>) = {T eSiB-.cfeT} 

gives a one-to-one correspondence between elements of B and clopen subsets of 
S(B). The topology on S(B) is generated by a basis consisting of all (clopen) sets 
of the form {x £ S(B) \ b £ x}, where b is an element of B. For every Boolean 
algebra B , S(B) is a compact totally disconnected Hausdorff space, and Stone 
representation theorem [56] states that every Boolean algebra B is isomorphic to 
the algebra of clopen subsets of its Stone space S(B). Note that the Stone dual 
of a countable Boolean algebra is a compact Polish space. The similarity of Stone 
duality with Gelfand representation is not surprising, if one considers the motivation 
that led Stone to this theorem: 
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“The writer’s interest in the subject, for example, arose in con¬ 
nection with the spectral theory of symmetric transformations in 
Hilbert space and certain related properties of abstract integrals.” 

(M.H. Stone [551 1 

2.2. Structural Limits. In the context of structural limits, the general picture 
of Fig. [I] takes more concrete form depicted on Fig. [2] This is a refinement of the 
approach the authors presented in [HI [Ml [321- 



Figure 2. The spaces considered in the study of structural limits 

Let us explain the role of the different spaces entering this scheme: We con¬ 
sider the class FO(ct) of all first-order formulas constructed with equality and the 
symbols in the considered signature a, and the Boolean algebra B defined as the 
Lindenbaum-Tarski algebra of FO(cr), that is the Boolean algebra of the classes 
of these formulas with respect to logical equivalence. For instance, in the case of 
undirected graphs, formulas are constructed from the symbols of equality and ad¬ 
jacency, as well as standard connectives (conjunctions, disjunction, negation) and 
quantification over vertices. 

The Stone space S{B) associated to B is a topological space, whose topology is 
generated by clopen subsets, which correspond exactly to first-order formulas (up 
to logical equivalence), that is to elements of B. A point in S{B) corresponds to a 
maximal set of consistent formulas. 

As to each formula cj> is associated a clopen subset K(cf)) of S(B ), the indicator 
functions 1 k (</>) of clopen subsets of S(B) are continuous functions from S(B) to M. 
An algebra 21 can be constructed from B as the algebra of formal finite real linear 
combinations of elements of B quotiented by the relation 0 + ^ = </>A'0 + </ , V'!/’- 
Each such finite linear combination can be written as a sum x = )T )" =1 a i < Pi where 
<f>i A <f>j = 0 whenever i ^ j. It turns out that ||x|| = max; |a;| is independent of 
the chosen decomposition, and defines a norm on 21 (this norm is nothing but the 
Woo norm on C(S(B))). The completion of 21 for this norm is the Banach algebra 
C(S(B)) of all continuous functions from S(B) to R. (Note that if we consider for 21 
complex linear combinations, we similarly construct the C*-algebra of all complex 
valued functions on S(B).) 
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Finite er-structures embed injectively in the space of additive functions on the 
Boolean algebra B by A i—>■ (■, A), where 


<6 A) 


|{(^i, ■ • ■ ,v P ) & A p : A |= ,...,u p )} 

\A\* 


The following fact is worth noticing: 


Fact 1. There is a one-to-one correspondence between probability measures /i on 
S(B) and additive functions : B —> [0,1] such that /(1) = 1, with the property 
that for every probability measure ^ on S(B) and every (j> G B it holds 

fM = ^K{<j>)). 

This fact, which we proved in |l5Di as a lemma, is actually known in the more 
general setting of MV-algebras mum. We give here a short proof for the sake of 
completeness: 


Proof. The vector space V(B) generated by the indicator functions 1 for cj> G B 
forms a subalgebra of C(S(B)). The subalgebra V(B) separates points of S(B): 
if Ti,T 2 G S(B), then there exists c/> G T\ \ T 2 thus lif( 0 )(Tj) ^ lK{<j>){Ti)- As 
the constant 1 function (corresponding to the maximum of the Boolean algebra) 
belongs to V(B), the subalgebra V(B) is dense in C(S(B)), according to Stone- 
Weierstrass theorem. As S(B) is a Radon-space, probability measures /i on S(B) 
correspond (in a one-to-one correspondence) to positive functionals F on C(S(B)) 
such that F m ( 1) = 1 (according to Riesz representation theorem). As V{B) is dense 
in C(S(B)), every positive functional on C(S((B)) is uniquely determined by its 
restriction on V(B), and conversely every positive functional on V(B) uniquely 
extend (by continuity) to a positive functional on C(S((B)). Moreover, a norm 1 
positive functional on V(B) is uniquely determined by its values on the generating 
set {1 K (<j>) '■ <t> € £>}, that is by the function : B —> [0,1] defined by = 

fj,(K((j>)). It is easily checked that satisfies / M (l) = 1 and 

<t> aV , = o => + /mW0> 

and that every function / satisfying these inequalities unic^uely defines a norm 1 
positive functional on V(B), hence a measure /x on S(B), such that / = / M . □ 

It follows that finite er-structures embed injectively in the space P(S(B)) of 
probability distributions on S(B): to a structure A with domain A we associate 
the unique measure /ia such that for every <j> G FO(cr) with free variables X\,... ,x p 
it holds 

[ lA( 0 )d^| p = (</>, A). 

J S(B) 

Then, a sequence (A n ) ne is} is FO-convergent if and only if the probability measures 
/xa„ converge weakly. 

More can be said when considering convergence of finite cx-structures. The group 
S u of permutations of N acts naturally on FO(cr) by permuting the free variables: 
for a formula <f) with free variables t,;, ,..., Xi and for a permutation r, the formula 
r • cj) with free variables Xj 1 ,..., Xj p where jj- = r(ife) is dehned by 

(t • 4>){x h ,...,x jp ):= (fixi, ,...,x ip ). 
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It follows that S u acts on the Boolean algebra B , and the action S u rx B defines an 
action S u rx S(B) on the Stone space of B. As it is clear that for every cr-structure 
A, every permutation r, and every first-order formula </> it holds 


(t ■ <j>, A) = {cf, A). 


Hence if a sequence (A„) ne rj is FO-convergent, then the measures p a„ converge 
weakly to some S^-invariant probability measure on S(B). More generally, ev¬ 
ery injection / : N — > N defines a transformation Pf : S(B) —> S(B ), which is 
continuous, which is a homeomorphism if (and only if) / is bijective (that is a 
permutation on N). The set of the transformations Pf has a monoid structure, as 
Pf o P g = Pf 0 g. Every measure p that is obtained either from a finite structure or 
as weak limit of measures associated to finite structures is invariant under every Pf. 
Hence (S(B),Y>s(B)i Ti P) is a measure preserving dynamical system, where Es(s) 
is the Borel cr-algebra of S(B) and P is the monoid of transformations indexed by 
injections / : N —> N. 

We summarize the situation as follows: 

Theorem 2. Let a be an at most countable signature, let X C FO(cr) be a fragment 
of first-order logic, let B be the Lindenbaum-Tarski algebra of X, let S be the Stone 
dual of B, and let P(S) be the space of probability distributions on S. Then: 

To each a structure A corresponds a measure pa such that for every formula 
<f> £ X with free variables in {xi,..., x p } it holds 



A sequence (A n ) n6 m of a-structures is X-convergent if and only if the associated 
measures pa„ converge weakly to some measure p £ P(S). In such a case, for 
every formula <j> £ X with free variables in {xi ,..., a: p } it holds 



Moreover, if T is a group of automorphisms of B (for instance the group of per¬ 
mutations of the free variables), then F acts naturally on S; if all the measures 
Pa associated to finite a-structures are T-invariant, then so are all the measures 
obtained as weak limits of measures associated to finite a-structures. 

The proof is an easy modification of the proof given in [30] . where we proved 
Theorem [2] without the appendix on group. 

2.3. Limits with respect to Parameters. The above abstract setting can be 
combined with ideas underlying left limits of graphs (as explained in [23]) and, 
particularly, by property testing. The universal framework, complementing the 
approach of [30], and using some of the above theory, is to build a notion of limits 


as follows: 


We consider a set O, whose elements we shall call objects, and a set T of bounded 
mappings / : O —> R, which we call parameters. Then we define the notion conver¬ 
gence of a sequence of objects with respect to the family of parameters. 

Because we are looking for a notion of limits with respect with the mappings 
in T, we consider on O the initial topology with respect to J-, that is the coarsest 
topology that makes every mapping f £ T continuous. Note that O is not Haus- 
dorff in general. Then the space Cb((D,R) of bounded continuous functions on O 
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with sup norm ||/|| = sup 0gC > |/(0)| is a commutative Banach algebra (that can be 
extended to a commutative C* -algebra). According to Gelfand representation theo¬ 
rem, Cb(0, R) is isometrically isomorphic to the algebra of continuous functions on 
a compact Hausdorff space, which is known to be homeomorphic to the Stone-Cech 
compactification (50 of O. Recall that the the Stone-Cech compactification (50 of 
O is the largest compact Hausdorff space generated by O, in the sense that any 
map from O to a compact Hausdorff space factors (in a unique way) through (50. 
Let Profile : O —> [0,1]^ denote the mapping defined by 

Profile(O) = (/(0))/ 6 jf, 
and let ~ be the equivalence relation 

0\ ~ O 2 •<==> Profile (Oi) = Profile(02)- 

Then KO = O/ ~ is the Kolmogorov quotient of O , and [50 is homeomorphic 
to the closure of {Profile(O) : O € O} in [0,1]^. 

This leads to the following natural notion of convergence of a sequence of objects 
of O with respect to parameters in F: 

Definition 3. A sequence (O n ) rae N is (F-convergent if, for every / G F the sequence 
(/(0„))„6N is convergent. 

Note that the limit of an ^-convergent sequence of objects in O is uniquely 
defined as a point of [50. 

If P € R[xi,..., x p ] is a real polynomial and € F, we denote by 

P(fi,... ,f p ) the mapping from O to K defined by 

P(f 1 ,...J p ):0^P(f 1 (0),...J p (0)). 

Let A(0,F) be the sub-algebra of Cb{0) formed by above mappings. Stone- 
Weierstrass theorem on uniform approximation of continuous functions by poly¬ 
nomials extends in this setting (and this is a folklore): 

Lemma 4. The sub-algebra A{0,F) is dense in Cb(0) = C(/30). 

Proof. The algebra A(0,5F) contains a non-zero constant (because of constant poly¬ 
nomials) and A(0, P) separates the points of (50 (as it separates the points of KO). 
Thus the result follows from Stone-Weierstrass theorem. □ 


Note that above results are very general, as we made no assumptions on our 
objects or parameters. Nevertheless, even that has some direct applications of this 
point of view to the theory of left-convergence. 

Let hom( A, G) denote the number of homomorphisms from F to G, and let 
t(F, G) be the homomorphism density of F is G defined by 


t(F,G) 


liom(F, G) 

jGp ’ 


that is the probability that a random map from F to G is a homomorphism. 


Proposition 1. Let O be the set of all finite graphs, and let T be the set of all the 
mappings G 1 —> t(F, G ) considered as mappings 

t{F,-):0-+[ 0,1]. 

Then the notion of convergence defined above is the left-convergence, and (50 is 
homeomorphic to the space of graphons. 
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Let SQ denote the algebra of standard quantum graphs, that is the commutative 
algebra constructed from vector space with basis formed by {K \} and all the finite 
graphs without isolated vertices, by defining multiplication by linearity from the 
case of finite graphs, defining the unit of the algebra as K\, and the product of two 
graphs without isolated vertices F\ and F 2 as their disjoint union. 

We shall make use of the following Lemma [23j Corollary 5.45, p. 74]: 

Lemma 5. The graph parameters hom(F, ■) (where F ranges over simple graphs) 
are linearly independent. Equivalently, the graph parameters hom(.F, •) (where F 
ranges over connected simple graphs) are algebraically independent. 

Proposition 2. Let O be the set of all finite graphs, and let F be the set of 
homomorphism densities 

t{F,-):0-+[ 0,1]. 

Then the mapping 

e i 

T : SQ -A A(0, F) ] Gq Fj ha ] afi(Fi, ■) 

i—1 i—1 

is an algebra isomorphism of SQ and A(0,F). 

Proof. The algebraic independence of the parameters t{F, ■ ) for graphs without 
isolated vertices will follow from the linear independence of the parameters t(F, •) 
for simple graphs F either equal to K\ or without isolated vertices , which we now 
prove: 

Assume that there exist non-isomorphic simple graphs F^..... Ff (all of them 
being either K\ or without isolated vertices) and reals a±,... ,ae such that 

t 

Y / a l t(F l ,G) = 0 
1=1 

holds for every graph G. Let N = maxf =1 |iq|, and let F( be the graph obtained 
from Ft by adding N — \Fi\ isolated vertices. Then 

hom(F/,G) = \G\Wt(F',G) = \G\ N t(F u G). 

Hence the equation Y)\=i a?: hom (A/, G) = 0 holds for every graph G. As no two 
graphs F( are isomorphic, it follows from Lemma [5] that a\, ..., a/ are all zero. □ 

Let us give two direct consequences of this lemma. The first consequence can be 
seen as an analog Stone Weierstrass uniform approximation of a continuous function 
by polynomials. 

Say that a graph parameter / is left continuous if the sequence (/(G„)) n6 N 
converges for every left convergent sequence of graphs (G n )„ 6 N- 

Proposition 3. For every left-continuous graph parameter f and every e > 0 there 
exists a quantum graph F = Xa=i a * such that for every graph G it holds 

|i(F,G)-/(G)| <e. 

Proof. This is an immediate consequence of the density of T(SQ) in C(/3G). □ 
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Say that a quantum graph F is non-negative (which we denote by F > 0) if 
t( F, G) > 0 for every graph G. The non-negativity of quantum graphs was subject 
to intensive study (see [23] )■ The second consequence gives yet another characteri¬ 
zation of this property. 

Proposition 4. Let F be a quantum graph. Then F > 0 if and only if for every 
e > 0 there exists a quantum graph H such that H > 0 and ||F — H 2 || < e, that is: 

inf f(H, G) > 0 and sup |t(F, G) - t(H 2 , G)| < e. 

G G 

Proof. One direction is clear. For the other direction, assume F > 0. Let h be the 
left-continuous graph parameter defined by h(G) = (t(F, G ) + e/2) 1 / 2 . Let H be a 
quantum graph such that ||/i — T(H)|| < a, where a(||F + e/2Ad|| 1 / 2 + a) < e/2. 
Then 

inf i(H, G) > inf t(h, G) - a > (e/2j 1 / 2 - a > 0. 

G G 

Moreover, 

ll(F+e/2/\ 1 ) —H 2 || = ||/i 2 -T(H 2 )|| < \\h+T(H)\\ ||/i-T(H)|| < (2\\h\\+a)a < e/2. 
Thus 

||F - H 2 1| < ||(F + e/2Ad) - H 2 || + ||e/21iC 1 || < e. 

□ 

It is also pleasant to note that the sup norm defined on Cb(0) defines naturally 
(by identification of SQ and A(G,J : )) defines a norm 

^ a*-Fi|| = sup y ^ajt(Fi,G) 


for quantum graphs. 

As we shall see later on, left-convergence of graphs is equivalent to (structural) 
QF _ -convergence, where QF~ is the fragment of quantifier-free formula without 
equality. The global situation, which we just outlined, is depicted on Fig. [3] 


3. Fragments of Interest 

We review here a more detailed analysis of the convergence notions based of 
Lindenbaum-Tarski algebras of different fragments, in the context of Section [2] and 
of our earlier approach |30| . We consider the following fragments: 

• FOo: the fragment of sentences; 

• FO p : the fragment of formulas with free variables included in {aq,..., x p }; 

• QF: the fragment of quantifier-free formulas; 

• F0 local : the fragment of local formulas; 

• F()/ cal : the fragment of local formulas with single free variable. 

Let us review some particular important cases of our theory induced by specific 
fragments of first-order logic. 
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Figure 3. Left-convergence and Structural QF -convergence. 


3.1. Elementary Limits. Our starting case consists in considering elementary 
convergence: A sequence (A n ) ne ^ is elementary convergent if, for every sentence 
(that is formulas without any free variables) 6 there is an integer N such that 
either all the A„ with n> N satisfy 0, or no A n with n > N satisfies 9. In other 
words, elementary convergence is convergence defined by the fragment FOo(c) of 
first-order sentences. The Stone dual S of the Lindenbaum-Tarski algebra of first- 
order sentences is the space of complete theories. Recall that a complete theory is 
a maximal consistent set of sentences. Godel’s celebrated completeness theorem of 
first-order logic asserts that every complete theory theory has a model. In other 
words, for every consistent set T C FOo (cr) of sentences there exists a cr-structure 
A that is a model of T, that is such that A satisfies every sentence in T. Moreover, 
according to Lowenheim-Skolem theorem, if the signature cr is at most countable 
then every consistent theory T C FOo (cr) has a model whose domain is at most 
countable. 

Conversely, to each cr-structure A one associates the complete theory Th(A) of 
A, which is the set of all the sentences satisfied by A. Although it is easily checked 
to the mapping A i —> Th(A) is 1 — 1 on finite structures, this is not the case for 
infinite structures; two structures A and B sharing the same complete theory are 
said to be elementary equivalent. 

In such a context, the Stone bracket (cj), A) gets only values 0 (if A (f>) or 1 
(if A \= (j>) , and the measure pa associated to A is a Dirac measure at the point 
Th(A). The class of all finite cr-structures can accordingly be identified with an 
open subset O of S. The elementary limits of FOo-convergent sequences of finite 
cr-structures correspond to the points of the closure of O, which correspond to the 
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complete theories T having the finite model property, that is the complete theories 
T such a every finite subset of T has a finite model. 

It follows that every FOo-convergent sequence of finite er-structures has a limit 
that can be represented as a cr-structure with an at most countable domain. 

Note that characterizing elementary limits of finite structures is essentially dif¬ 
ficult, as finite model property is not decidable in general. However, it is worth 
noticing that first-order formulas without functional symbols where all existential 
quantifications appear first in the formula, has the finite model property. Precisely, 
Ramsey [35] showed that a sentence 

Bx! ...BxnVyi ...Vy m 

(where (j) is quantifier-free and has no function symbols) has a model if and only if 
it has a model of size bounded by n plus the number of constants in (j). 

3.2. Left limits and the Quantifier Free Fragment. We can precise our in¬ 
tuition by considering the case of undirected graphs with convergence driven by 
the fragment QF - of quantifier free formulas without equality (meaning that the 
equality symbol cannot be used). It is easily checked that the corresponding notion 
of convergence of a sequence (G„) ng ^ of graphs is nothing but the left-convergence 
introduced by Lovasz et al., which is based on the convergence of the homomor¬ 
phism profile t, which associates to each finite graph F the probability t(F, G n ) that 
a random map from F to G n is a homomorphism (that is an adjacency-preserving 
map). The Stone dual S^QF - ) of the Lindenbaum-Tarski algebra of QF^ can be 
described as follows: each point p £ S(QF~) is a maximal consistent set of formu¬ 
las QF _ , hence is uniquely determined by either Xi ~ Xj or -> {xi ~ xfi) for each 
pair (i,j) £ N 2 , stating that Xi is adjacent or not to Xj. Each point p can thus 
be represented by means of a (labeled) countable graph with vertex set N, and the 
left limit of a sequence of graphs can be represented as an ^-invariant probability 
distribution on the Stone space, that is as an infinite exchangeable random graph. 
Then it follows from Aldous and Hoover extentions of de Finetti’s theorem to ex¬ 
changeable arrays [2, E] that left limits of graphs can be represented by means 
of a graphon, that is a symmetric measurable function W : [0,1] x [0,1] —► [0,1]. 
However, note that in the case of the fragment QF _ , the mapping G <—> pc is not 
injective, as two vertices that can be uniformly blown up in order to obtain a same 
graph are mapped to the same probability measure. This special aspect is due to 
the weakness of expressive power of the QF _ fragment, and it disappears when one 
considers the fragment QF of all quantifier-free formulas, which essentially defines 
the same notion of convergence. 

3.3. Local limits and the FO 1 ] 003,1 fragment. We now consider the case of undi¬ 
rected graphs with degree at most D, and the fragment FO\ ocal of local formulas 
with a single free variable. Recall that a formula f> is t-local if its satisfaction only 
depends on a distance t-neighborhood of the free variables, and that <p is local if it 
is t-local for some t € N. 

Local convergence of graphs with bounded degree has been defined by Benjamini 
and Schramm [5]. In our setting, local convergence can be defined as follows: A se¬ 
quence (G ra )neN of graphs with maximum degree D is locally-convergent if, for every 
r £ N, the distribution of the isomorphism types of the distance r-neighborhood of 
a random vertex of G n converges as n goes to infinity. Local convergence witnesses 


14 JAROSLAV NESETRIL AND PATRICE OSSONA DE MENDEZ 

the particular importance of the fragment F0 1 1 ocal : As each isomorphism type T of 
the distance r-neighborhood of a vertex can be characterized by the satisfaction of 
an r-local formula formula <Pt(x) (where x stands for the root vertex), it follows that 
FO]° ca -convergence implies local convergence. Conversely, as the satisfaction of an 
r-local formula with a single free variable only depends on the isomorphism type 
of the (rooted) distance r-neighborhood of the free variable, F O 'i' 303 ' - convergence is 
equivalent local convergence. 

In general, points of the Stone dual of FO)° cal correspond to the complete theories 
of rooted connected structures. As we consider graphs with bounded degrees, we 
know that two rooted connected countable graphs with maximum degree at most 
D are elementarily equivalent if and only if they are isomorphic. It follows that 
in this case the Stone dual of FO 1 ] 003 ' is the space of all (isomorphism classes of) 
rooted connected countable graphs with maximum degree D. 

3.4. Interrelations of Fragments and Reductions. A peculiar feature of the 
fragments FOo and F0 local , stated as Theorem [?J is a consequence of Gaifman 
locality theorem m- This we recall now: 

Theorem 6. For every first-order formula <p(x \,..., x n ) there exist integers t and r 
such thatcj) is equivalent to a Boolean combination of t-local formulas ^ s (xi ± ,... , x ia ) 
and sentences of the form 


(8) 3y 1 ...3y m ( f\ dist(j/j, yj) > 2r A f\ ip{yi) j 

l<i<m ' 

where ip is r-local. Furthermore, we can choose 

r < 7 qrank( 0 )-i ; t < ( 7 qrank(,«-i _ i)/ 2) m <n + qrank(0), 

and, if is a sentence, only sentences ([8]) occur in the Boolean combination. More¬ 
over, these sentences can be chosen with quantifier rank at most /(qrank(</>)), for 
some fixed function f. 

The proof of the following reduction theorem essentially uses Theorem [6] 

Theorem 7 (|30j). Let (A„) be a sequence of finite X-structures. Then (A„) 
is FO -convergent if and only if it is both F0 loc3 -convergent and FO 0 - convergent. 
Precisely, (A n ) is FO p -convergent if and only if it is both FO x ° cal -convergent and 
FOo -convergent. 

Of course, if we constrain the class of structures on which we study limits, we get 
stronger reductions. For example, we now prove that in the case of a sequence of 
vertex-transitive structures in a wide class, most of the hierarchy of A-convergence 
collapses. Recall that a class of graphs C is wide if, for every integers d,m there 
is an integer N(d,m) such that every graph G £ C with order at least N{d,m) 
contains a subset of m vertices pairwise at distance at least d 2]. (In particular, 
every class of graphs with bounded degree is wide.) 

Lemma 8. For every sentence 0 there exists constants r, to and a formula p £ 
pQiocai j or ever y vertex-transitive A- structure A with at least m vertices 

pairwise at distance greater than 2r it holds 

A\= 9 <?=* A\=3xcp{x) 


\/x 4>{x) 


<0,A) = 1. 
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Proof. If A is vertex-transitive then for every u,v £ A and every <fi £ FOi it 
holds A |= <j>(u) if and only if A |= <f>(v). Hence A |= 3xcj)(x) is equivalent to 
A |= Va; 4>(x). 

According to Theorem [6j the sentence 6 is equivalent to a Boolean combination 
of sentences of the form 

A\=3y 1 ...3y m ( f\ dis%j, yf) > 2r A f\ 

M<i<j<ra l<i<m ' 

•<=>• A 1= 3yi ... 3y m ( dist(y*, %) > 2r) A 3y f\ ip{y) 




l<i<m 


<*=> A \= 3y /\ ip(y) 

l< 2 <m 

(where the first equivalence comes from vertex-transitivity, and the second from 
the existence of m vertices far apart.) Moreover, by vertex transitivity, for every 
^,^2 e FO 1 ™ 3 - 1 it holds 

A |= (3x\ <j>\{x{)) A (3xi <^ 2 (^ 2 )) A (= (3x A ^(x)). 

It follows that the Boolean combination of the conditions A |= 3y /\ 1< - <m ip(y) is 
equivalent to the condition A \= 3xcj){x) for some <j> £ FOj oca . □ 

As a consequence, we obtain the following: 

Theorem 9. Let C be a wide class of vertex-transitive X-structures. Then, for 
every sequence (A n )„ e N with A n £ C and \A n \ —>• 00 the following conditions are 
equivalent: 

(1) the sequence (A n ) ne Fj is FO- convergent, 

(2) the sequence (A„) n£ N is FOi cal -convergent, 

(3) for every (f> £ F0^ oca , either (3a;) 4>{x) is satisfied by all but finitely many 
A n or (3a;) <fi(x) is satisfied by only finitely many A n , 

(f) the sequence (A n ) n£ N is FOo- convergent. 

Proof. That (|T]) implies (f2|) is trivial. That <[2j) is equivalent to ([3| follows from 
vertex-transitivity. That ^3| implies Q follows from Lemma |8] and that Q im¬ 
plies © is trivial. That © implies F0 local convergence is a consequence of Gaifman 
locality theorem and wideness of C. Finally, that © together with F0 local conver¬ 
gence implies ([I]) follows from Theorem [?J □ 

Let us formulate the following consequence for Cayley graphs. 

Corollary 1. Let d £ N, and let (G n ) rae n be a sequence of (edge-colored directed) 
Cayley graphs generated by d elements of groups with orders going to infinity. Then 
the following conditions are equivalent: 

(1) the sequence ( G n ) n is TO-convergent, 

(2) the sequence (G n ) ra <=N is FO 1 ^ 1 -convergent, 

(3) the sequence ( G n ) n is FOo -convergent. 

We have already noticed (Theorem [7| that FO-convergence can be reduced to 
FOo-convergence and to F0 local -convergence (thanks to Gaifman locality theorem). 
Furthermore, for wide classes (like classes with bouded degree), F0 local -convergence 
is equivalent to FO l 1 ocal -convergence. This explains the particular importance of the 
fragments F0 local and FO'|° cal . 
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4. Limit Connectivity 

The importance of the fragments reviewed in the previous section also appears 
in the study of the limit notion of “connected components” for a convergent se¬ 
quence of A-structures. Note that connectivity of structures (which fails to be 
first-order definable) plays an important and non-trivial aspect of convergence of 
sparse graphs. The relative size and the speed of convergence plays a role here. 
Part of this problem is expressed by the following notions: 

For a cr-structure A, a vertex v £ A, and an integer d , we define Bd( A, v) as the 
substructure of A induced by vertices at distance at most d from v in A (that is at 
distance at most d from v in the Gaifman graph of A). 

Definition 10 (Residual sequence). A sequence (A„) ng N of A-structures is residual 
if 

lim limsup sup pa„ (Bd(A n , v)) = 0. 

d—‘>oo n—voo v£A n 

In other words, a sequences is residual if its limit has only zero-measure connected 
components 

Definition 11. A sequence (A„)„ g fsj of A-structures is non-dispersive if 
lim lirninf sup pa„ (Bd(A n , v)) = 1. 

d—> OO Tl—> OO V (ZJ{^ 

In other words, a non-dispersive sequence is a sequence whose limit is essentially 
connected. 

For a cr-structure A and a vertex p £ A, we denote by (A, p) the rooting of the 
structure A at p, that is the cr*-structure (where a* is obtained by adding a unary 
symbol R to signature a) obtained from A by putting exactly p in relation R. 

In the case of rooted structures, we usually want a stronger statement that 
the structures remain concentrated around their roots: a sequence (A n ,p n )neN of 
rooted A-structures is p-non-dispersive if 

lim lirninf p A „(5d(A„,p„)) = 1. 

d—>oo n—>oo 

The notion of non-dispersiveness is only an approximation of connectiveness. As 
such it is not supported by a single equivalence relation. However, we can intro¬ 
duce the notion of a component relation system, which approximates component 
equivalence. 

Definition 12. A component relation system for a class C of A-structures is a 
sequence Wd of equivalence relations such that for every d £ N and for every A £ C 
there is a partition of the w^-equivalence classes of A into two parts £o(vJd, A) and 
£+(md,A) such that: 

• every class in £q (wd, A) is a singleton; 

• v^(\J£ 0 {m d ,A)) < e(d)+rj(\A\) (where Hindoo e(d) = lim^oo p(n) = 0); 

• two vertices x, y in (J £ + (wd, A) belong to a same connected component of 
A if and only if A |= Wd(x, y) (i.e. iff x and y belong to a same class). 

Definition 13 ([33]). A family of sequence (A, jn ) ng N (i £ I) of A-structures is 
uniformly elementarily convergent if, for every formula <j> £ FOi(A) there is an 
integer N such that it holds 

V* £ I, Vn' >n> N, (A i>n |= (3x)<j>(x)) => (A i( „/ (= (3 x)(j>(x)). 
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(Note that if a family (Aj !n ) ne isj ( i £ I) of sequences is uniformly elementarily 
convergent, then each sequence (A; „) n gN is elementarily convergent.) 

Now that we have introduced all the necessary notions, we can state the follow¬ 
ing fundamental result, which allows to study F0 local -convergent sequences (and 
more generally FO-convergent sequences) of disconnected A-structures essentially 
component-wise. 

Theorem 14 (Extended comb structure [32]). Let (A„) ng jj be an FO local -convergent 
sequence of finite X-structures with component relation system Wd- 

Then there exist I C N U {0} and, for each i £ I, a real ai and a sequence 
(B g „) ngN of X-structures, such that A n = Ui gJ B Jirl (for all n£N), ]Tb gJ a* = 1, 
and for each i £ I it holds 

• OLi = lim^oo and a z > 0 if i ^ 0; 

• if i = 0 and ao > 0 then (B gn ) 7l6 N is F0 local -convergent and residual; 

• if i > 0 then (B grl )„ g N is F0 local -convergent and non-dispersive. 

Moreover, if (A„) ng N is FO -convergent we can require the family {(Bi jn ) ng N : i £ 
1} to be uniformly elementarily-convergent. 

The proof of Theorem[l4]is elaborated as it needs a detailed analysis of the speed 
of growth of components and we refer to }32| for proof. An important consequence 
of this theorem is to reduce the problem of the construction of limit objects to 
the basic cases of residual sequences and non-dispersive sequences, see for instance 
Theorem [T9] 


5. Limit Objects of Sparse Structures 

5.1. Borel Structures. Given a signature cr, Borel a-structure is a cr-structure A, 
whose domain A is a standard Borel space, such that: 

• for every relational symbol R £ a with arity r, the set 

R A = {(ri, ...,v r ) £ A r : A |= R(v i,.. .,v r } 
of R in A is a Borel subset of A r ; 

• for every functional symbol / £ cr with arity r, the corresponding map 
f A : A r —> A is a Borel map. 

Note that Borel structures are a natural generalization of Borel graphs (see [20] 1. 

It is easily checked that if A is a Borel cr-structure and if v is a probability 
measure on A, then for every quantifier-free formula </> £ QF(cr), the set <p{A) is 
Borel. Whence we can extend the definition of Stone bracket to pairs formed by 
a Borel structure A equipped with a probability measure v and a quantifier free 
formula <p with free variables in x\, ..., x p by 

(0, (A,p)) = */^(A)). 

Then, we shall say that a Borel cr-structure A equipped with a probability measure 
v is a QF-limit of a sequence (F n ) ng N of finite cr-structures if for every quantifier 
free formula </> it holds 

(</>, (A,i ')) = lim (</>, F„). 

n—> oo 

Example 15. Let (G n )„ g N be a left convergent sequence with \G n \ —> oo. 
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Then there exists a Borel graph G with a probability measure v such that (G, v ) 
is a QF-limit of the sequence (G n )„ g N if and only if the sequence (G n )„ g N converges 
to a random-free graphon, that is a graph which is {0, l}-valued almost everywhere. 

Some more exotic examples can be obtained by considering functional symbols: 

Example 16 ([2]). A tree semi-lattice is a structure A whose signature only con¬ 
tains a binary functional symbol A, which satisfies the following axioms: 

(1) the operation (defined by) A is associative, commutative, and idempotent; 

(2) for every x, y, z such that x A z = x and y A z = y it holds x Ay £ {t, y}. 

Every QF-convergent sequence (T„)„ g N of tree semi-lattices with fc-colored do¬ 
main there exists a Borel tree semilattice L with fc-colored domain and a probability 
measure v such that (L, v) is a QF-limit of the sequence (T„) ng jj. 

Example 17. In this example, let (G„)„ 6 h be a sequence of finite nonabelian 
groups with increasing orders. Assume each G n is either simple or is a symmetric 
group. Then the sequence (G n ) ng N is QF-convergent and GL(2,M) (with Haar 
probability measure) is a QF-limit of (G n ) ng N. 

Indeed, according to m, the probability that a non-trivial fixed word w equals 
identity tends to 0 as n goes to infinity, and the same holds for the sequence of sym¬ 
metric groups, according to [lRj . Thus, for every quantifier formula ... ,x p ), 
the probability that ..., x p ) will hold in G n for n going to infinity for indepen¬ 
dent uniform random assignments of x±,... ,x p tends either to 1 or 0, depending 
on the fact that <j>(xi ,... ,x p ) holds trivially or not. Also, according to [T3], the 
the probability that a non-trivial fixed word w equals identity is 0 for a connected 
finite-dimensional nonsolvable Lie groups (for instance GL(2,R)). Thus GL(2,R) 
is a QF-limit of (G n )„ g m. 

5.2. Modelings. We introduced in [33) — as candidate for a possible limit object of 
sparse structures — the notion of modeling, which extends the notion of graphing 
introduced for bounded degree graphs. A relational sample space is a relational 
structure A (with signature A) with additional structure: The domain A of A 
is a standard Borel space (with Borel cx-algebra £a) with the property that every 
subset of A p that is first-order definable in FO(A) is measurable (in A p with respect 
to the product a-algebra). A modeling is a relational sample space equipped with 
a probability measure (denoted vjsf). For brevity we shall use the same letter A 
for structure, relational sample space, and modeling. The definition of modelings 
allows us to extend Stone pairing naturally to modelings: the Stone pairing (<j>, A) 
of a first-order formula cf> (with free variables in {aq,..., x p }) and a modeling A, is 
defined by 

<0,A> = i/®*(0(A)), 

where 

<K A ) = {(ui, ■ ,v p ) e A p : A |= <j>{vu---,v p )}. 

Note that every finite structure canonically defines a modeling (with same universe, 
discrete cr-algebra, and uniform probability measure) and that in the definition 
above matches the definition of Stone pairing of a formula and a finite structure 
introduced earlier. Also note that every modeling cr-structure is obviously a Borel 
a-structure, but that the converse does not have to hold in general, as projections 
of Borel sets are not Borel in general. 


FIRST-ORDER LIMITS, AN ANALYTICAL PERSPECTIVE 


19 


For a fragment X of FO, we shall say that a sequence (A n ) n£ N is X-convergent 
to a modeling L (or that L is a modeling X-limit of (A n ) ng isj), and we shall note 
A n —> L, if for every cj> G X it holds lim n _ > . 00 ((^, A„) = (</>,L). We shall say that 
a class C of A-structures has modeling X-limits if, every X-convergent sequence 
(A ra ) ng N of A-structures with A n G C has a modeling X-limit. For instance, we 
proved in [[53] that classes of graphs with bounded degrees and classes of graphs with 
bounded tree-depth have modeling FO-limits, and we proved in [32j that the class 
of rooted (k vertex-colored) trees has modeling FO-limits. However, the notion of 
modeling limit is, in some sense, only applicable to sparse structures: 

Theorem 18 ( [.'{.'ll1. Let C be a monotone class of graphs. 

If C has modeling FO-limits then C is nowhere dense, that is: for every integer 
p there exists an integer N = N(C,p) such that no graph in C contains the p 
subdivision of as a subgraph. 

For more on nowhere dense graphs, we refer the reader to mum muni. The 
importance of nowhere dense classes and the strong relationship of this notion with 
first-order logic is exemplified by the recent result of Grohe, Kreutzer, and Siebertz 
[18] , which states that (under a reasonable complexity theoretic assumption) de¬ 
ciding first-order properties of graphs in a monotone class C is fixed-parameter 
tractable if and only if C is nowhere dense. Motivated by strong model theoretical 
properties and manifold characterizations of nowhere dense classes, we conjectured 
that the above theorem is tight. This may be seen as the most challenging problem 
of this paper. 

Conjecture 1. Every nowhere dense class of graphs has modeling FO-limits. 

The problem of the existence of a modeling limit can be reduced to the study of 
FO^caheonvergence, and then to two “typical” particular cases: 

A modeling A with universe A satisfies the Finitary Mass Transport Principle 
if, for every 4>,if G FOi(A) and every integers a,b such that 

UF (3 ^ a y) (x\ ~ y) A ip(y) 

[ip b (3- b y) (xi ~ y ) A (f{y) 

it holds 

a (0, A) < b (ip, A). 

It is clear that every finite structure satisfies the Finitary Mass Transport Princi¬ 
ple, hence every modeling FO-limit of finite structures satisfies the Finitary Mass 
Transport Principle, too. 

The following stronger version of this principle, which is also satisfied by every 
finite structure, does not automatically hold in the limit. 

A modeling A with universe A satisfies the Strong Finitary Mass Transport 
Principle if, for every measurable subsets X, Y of A, and every integers a, b, the 
following property holds: 

If every x G X has at least a neighbors in Y and every y G Y has 
at most b neighbors in X then av a(X) < bvj±(Y). 

The importance of residual and non-dispersive sequences appears again in the 
following result, which complements Theorem |14| 
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Theorem 19 ([32]). Let C be a hereditary class of structures. 

Assume that for every A n £ C and every p n £ A n (n £ NJ the following proper¬ 
ties hold: 

(1) if (A n ) n£ N is FO l f cal -convergent and residual, then it has a modeling FO) 0 ™ 1 - 
limit; 

(2) if(A n , p n ) n eN is F0 local -convergent and p -non-dispersive then it has a mod¬ 
eling FO local -limit. 

Then C has modeling FO -limits. 

Moreover, if in cases (1) and (2) the modeling limits satisfy the Strong Finitary 
Mass Transport Principle, then C has modeling FO -limits that satisfy the Strong 
Finitary Mass Transport Principle. 


6. Constructions 

In this section we add two useful extensions of some of the above results, by means 
of two basic operations. The first is the notion of (linear) convex combination of 
modelings. This may be used to give an inverse theorem for the comb structure 
Theorem [14] The second introduces the powerful tool of interpretation schemes, 
which gives the possibility to transport results from a class of A-structures to a class 
of er-structures. This also leads to a new characterization of nowhere dense classes. 


6.1. Convex Combinations. 


Definition 20 (Convex combination of Modelings). Let Hi be A- modelings for 
i £ I C N and let (aj)j e j be positive real numbers such that Y^iei Q » = 1- 

Let H be the disjoint union of the H,, let Eh = IIJ,- A', : X, £ Eh i and, for 
A € E h , let v H (X) = £. (A n H t ). 

Then H is the convex combination of modelings H; with weights cti and we 
denote it by JJ ieJ (H i; a*). 


The following converse of Theorem 14 is proved in 


Theorem 21. Assume J is a countable set, a* (i £ I) are reals, and (Bi in )neN 

IB' I 

(i £ I) are sequences of A- structures such that a>i = limn-n*, tW— —r (V* £ I), 

I U jei a 3,n\ 

oti = 1, and for each i £ I, {B i n ) nG ^ is F0 local -convergent. Then A n = 
u ie/ B i n is F0 local -convergent. Also, if there exist X-modelings Lj (i £ I) such 

PQlocal jpQlocal 

that for each i £ I , B , „ - > L i, then A n - > n i6 /(L i, a.i). 

Moreover, if the family {(Bi „)„ 6 N : i £ 1} is uniformly elementarily-convergent, 

then (A n )„ £ N FO-convergent. Also, if there exist X-modelings Lj (i £ I) such 

FO 

that for each i £ I it holds B- > Lj (for i > 0 and i = 0 if ao > 0) and 

B 0 ,n L 0 (ifa 0 = 0) then A n U ieJ (Li, af). 


6.2. Interpretation Schemes. Interpretation Schemes (introduced in this setting 
in (33]) generalize to other logics than first-order logic. 


Definition 22. Let £ be a logic (here either first-order logic or C UlU1 ). For p £ N 
and a signature A, C p ( A) denotes the set of the formulas in the language of A in 
logic C, with free variables in {x\,... ,x p }. 

Let k, X be signatures, where A has q relational symbols Ri,... ,R q with respec¬ 
tive arities r\,...,r q . 
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An £-interpretation scheme I of A-structures in re-structures is defined by an 
integer k — the exponent of the C -interpretation scheme — a formula E £ ,C- 2 k( K )i 
a formula 9q £ £*,(«), and a formula Oi £ FO ri /c(re) for each symbol Ri £ A, such 
that: 

• the formula E defines an equivalence relation of fc-tuples; 

• each formula 6i is compatible with E, in the sense that for every 0 < i < q 
it holds 

A E ( x Eyi) h 6»i(xi,...,x ri ) ca 6»i(yi,...,y ri ), 

l<j< r i 

where ro = 1, boldface Xj and y : j represent fc-tuples of free variables, and 
where ffc(x 1; ... ,x r .) stands for ... ,Xi t k,... ,x ri! i,... ,x ri ^)- 

For a re-structure A, we denote by 1(A) the A-structure B defined as follows: 

• the domain B of B is the subset of the -E-equivalence classes [x] C A k of 
the tuples x = (aq,..., aq) such that A |= f?o(x); 

• for each 1 < i < q and every vi,..., v Si £ A kri such that A |= 9o(vj) (for 
every 1 < j < r*) it holds 

B |= -R»([vi],..., [v r J) <S=> A |=0i(vi,...,v ri ). 

From the standard properties of model theoretical interpretations (see, for in¬ 
stance [22J p. 180), we state the following: if I is an C -interpretation of A-structures 
in K-structures, then there exists a mapping I : £(A) —> C{n) (defined by means 
of the formulas E,9q, ... ,6 q above) such that for every <j> £ £ P (A), and every re¬ 
structure A, the following property holds (while letting B = 1(A) and identifying 
elements of B with the corresponding equivalence classes of A k ): 

For every [vi],..., [v p ] £ B p (where v* = (ujp,..., v^k) £ A k ) it holds 

B l=0([vi],... ,[v p ]) A |=T(0)(vi,...,v p ). 

It directly follows from the existence of the mapping I that 

• an FO-interpretation scheme I of A-structures in re-structures defines a con¬ 
tinuous mapping from 5(E(FO(re))) to 5(E(FO(A))); 

• an £ WlCJ -interpretation scheme I of A-structures in re-structures defines a 
measurable mapping from S(B(FO(k))) to S(B(FO(X))). 

Definition 23. Let re, A be signatures. A basic C-interpretation scheme I of A- 
structures in re-structures with exponent k is defined by a formula 9 j £ C^n (k) for 
each symbol Ri £ X with arity r % . 

For a re-structure A, we denote by 1(A) the structure with domain A k such that, 
for every Ri £ X with arity r* and every vi,..., v n £ A k it holds 

1(A) |=i?j(vi,...,v n ) A |= 0i(vi,...,v ri ). 

It is immediate that every basic E-interpretation scheme I defines a mapping 
I : £(A) —>• £(re) such that for every re-structure A, every <f> £ E P (A), and every 
vi,..., v p £ A k it holds 

1(A) |= </>(vi,... ,v p ) <«==> A |=T(0)(vi,...,v p ) 

We deduce the following general properties: 
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Proposition 5 ([33]). Let I be an FO -interpretation scheme of X-structures in 
K-structures. 

Then, if a sequence (A n ) n£ N of finite K-structures is FO -convergent then the 
sequence (l(A„)) n6 N of (finite) \-structures is TO-convergent. 

Proposition 6 ([32]). Let I be a basic -interpretation scheme of X-structures 
in K-structures. 

For every K-modeling A, 1(A) is a X-modeling such that for every <f> £ £ p (A) it 
holds 

(cf, \(A)) = m,A). 

Interpretations are a powerful tool. For a recent application to graph polynomi¬ 
als, see Em. 


7. Open Problems 

Our main conjecture here is Conjecture [TJ which asserts that every monotone 
nowhere dense class of graphs has modeling limits. 

There is a modest progress toward a resolution of this conjecture: 

• any monotone class of graphs with bounded degree has modeling limit 15D| , 

• the class of (colored rooted) forests has modeling limits [52] . 

As an extension of the results in [32], every FO-convergent sequence (G„) ne pj with 
girth(G„) -A oo has a modeling limit. From this follows the first positive result 
concerning nowhere dense classes which do not have bounded average degree. 

For a graph G, we denote by b\(G) the cyclomatic number of G (i.e. b±(G) = 
||G|| — |G| + 1), and by Diam(G) its diameter. 

Proposition 7. Let f : N — > N be a mapping and letCf be the monotone nowhere 
dense class of all (colored) graphs G such that for every graph G £ C it holds 

bi(G) < /(Diam(G)). 

Then the class Cf has modeling limits. 

Note that such classes include in particular all classes with bounded degree, and 
more generally classes of graphs in which the maximum degree is bounded by a 
function of the girth. Proposition [7] is currently our most general result toward 
Conjecture [T] 

Problem 4. We consider 2-colored linear order, that is transitive tournaments with 
vertices colored black or white. 

Do every FO-convergent sequence of 2-colored linear order admit a modeling 
FO-limit? 

Note that if the answer to Problem [4] is yes, then it follows (by suitable interpre¬ 
tation) that every class of graphs with bounded pathwidth has modeling FO-limits. 
Similarly, if the above Example [16] extends to FO-convergence in the sense that 
every FO-convergent sequence of tree semilattices with fc-colored domain has a 
modeling FO-limit then it would imply that every class of graphs with bounded 
treewidth has modeling FO-limits. 

Quantifier-free fragment corresponds to the best known (and thoroughly inves¬ 
tigated) type of convergence, which is left-convergence in the case of graphs and 
hypergraphs. However, our knowledge of QF-convergence is far from being com¬ 
plete. First, it is not completely clear what form the limit object should have in 
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case of a relational structures with several non-unary relations. More important, 
the extension of the theory (notions of (hyper)graphons, cut metric, regularity 
theorem) in the simple case of a signature reduced to a single binary function is 
completely open. In general this problem might be too difficult to be directly ad¬ 
dressed. It appears that a natural restriction consists in limiting the power of the 
binary function: 

Problem 5. Let a be a signature reduced to a single binary function * (denoted 
as an operation), and let T 0 be a finite set of universal formulas (in the first-order 
language of a). Assume that there exists a function / such that for every p, every 
model A of To, and every v\,..., v p £ A, the er-structure A(vi, ..., v p ) generated 
by iq , ,v p — that is the substructure of A whose domain is the smallest subset 
of A which contains Vi,... ,v p and is closed under the operation * — has a domain 
of cardinality at most f(p). 

Does there exist a graphon-likc limit object for QF-convergent sequences of finite 
models of To? Does there exist a regularity theorem for finite models of To? 

Note that in some simple cases, we can answer positively. For instance in the case 
of tree-semilattices [9], which corresponds to associative, commutative, idempotent 
operation * with the additional property 

\/x\/y\/z [(a: * 2 : = x) A (y * z = y)} —> [(x * y = x) V (x * y = y)]. 

However, this case is too simple in the sense that limit objects are Borel tree- 
semilattices, which means that tree-semilattices form a “random-free” class. 

A possible candidate for a tractable non random-free example is the class of 
general semilattices, defined by general associative, commutative, idempotent op¬ 
erations *. 

We can also consider signatures er only containing unary functional symbols. In 
the case of a signature cr reduced to a single unary function, it appears that not 
only a limits of QF-convergent sequences of finite structures can be represented by a 
Borel (7-structure, but the class of these cr-structures actually admit modeling FO- 
limits, as an extension of the results in [32] ■ Note that for a signature a consisting of 
at least two unary functional symbols, there is no hope to have modeling FO-limits 
(as such a class is sufficiently general to allow in it an interpretation of the class of 
all directed graphs) 
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